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ABSTRACT 

Tiny systematic uncertainty caused by cosmological hypotheses is hard to be detected, 
not only because the present observational errors are relatively large but also because 
hypothesis-induced uncertainty is indistinguishable from other sources of systematic 
errors. We introduce an efficient and sensitive method for detecting tiny systematic 
errors, which contain the cosmological-hypothesis-induced uncertainty and other sec¬ 
ondary systematic errors, hidden behind residuals of chi-square analysis. In this paper, 
we apply our analysis to JLA compilation of SN la observations and latest cosmic 
chronometer data-set. We find slight but noticeable evolutional feature in residuals 
of chi-square analysis under present systematic uncertainty control, when combining 
JLA samples with standard cosmological model. Meanwhile, cosmic chronometer ob¬ 
servation has no noticeable similar feature with various cosmological models, which 
may be covered up by relatively large observational uncertainties. Our method can be 
useful when various independent observational samples with high observational preci¬ 
sion are available, since the cosmological hypothesis-induced error appears unbiasedly 
in all related data-sets. 
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1 INTRODUCTION 

With deeper and more precise astrophysical observations 
coming around the corner, cosmologists are confident in dis¬ 
covering the nature of dark sections (ie., dark energy and 
dark matter) in the universe. More specifically speaking, fu¬ 
ture observations will enable us having more careful review 
upon various non-standard hypotheses and better estima¬ 
tion on theoretical parameters. 

It is commonly accepted that the standard cosmological 
model ACDM although perfect enough to fit extremely well 
to most astrophysical observations, it contains unknown en¬ 
ergy components in theoretical perspective. The key to the 
question about what the dark sections are and how to find 
imperfectness of standard cosmology, lies in seeking similar 
feature in deviation from “standard” prediction according 
to various observations. 

Researchers are always concerning about removing all 
possible sources of significant systematic errors before cos¬ 
mological parameter estimation with chi-square analysis 
which is critical for providing more robust and convincing re¬ 
sults. We also notice that chi-square analysis is naturally not 
highly sensitive to some secondary systematic errors which 
are almost un-noticeable with respect to dominant observa¬ 
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tional uncertainties and are usually neglected in systematic 
error removing. 

Since chi-square analysis relies on weighted summation 
of squares of residuals, the possible evolutional feature in 
the residuals, which represents the hidden systematic un¬ 
certainties, may be ignored in data analyzing. This may re¬ 
sult in tiny systematic errors, which are although far more 
less significant but also affecting the accuracy of estimation 
and blinding us from knowing the truth precisely. Since such 
small errors are seldomly concerned or detected in previous 
researches, we name it hidden uncertainties. Sources of hid¬ 
den systematic uncertainties may come from unconcerned 
errors in observation, data selection, data analysis or theo¬ 
retical hypotheses. 

With present quality and quantity of observations, it 
is hard to find clear evidence for non-standard cosmo¬ 
logical expansion history. This obstacle is caused by the 
fact that systematic uncertainty originated from possibly 
imperfect cosmological hypothesis, ie., constant dark en¬ 
ergy term, is much smaller than dominant systematic er¬ 
rors in observed data samples. This means indications 
of new physics lie in the hidden uncertainties. Previ¬ 
ous researc hes suggest that hypothesis-i n duced uncertainty 
may exist dBenitez-Herrera et ahl 120131 : IZhao et al.l 120121 : 
IZhang fc Ma 20131 ). 

Then the following task is about how to find the sig- 


© 2015 RAS 













2 J. Wang and X. Meng 


nal of hidden uncertainties against observational noises. Pre¬ 
cisely speaking, the signal which we are looking for, performs 
as a specific form of systematic uncertainty while we esti¬ 
mating ACDM model parameters with observed samples. 
We separate the task into two steps, the first step is about 
introducing diagnostic method that suits various observa¬ 
tions and theoretical predictions; and the second step con¬ 
cerns finding similar feature shared by various observations 
in diagnostic results. 

The following section serves as a brief review about 
analysing schemes used in previous hypothesis tests. Then 
we move on to try detecting hidden systematic uncertainties 
with diagnostic function. 


2 HYPOTHESIS TEST 


The basis of Bayes theorem lies in its explanation of proba¬ 
bility which reads 


P(Ai\B) 


P(B\Ai)P(Ai) 

E i P(B|T l )P(A i )’ 


( 1 ) 


where A can be regarded as a set of hypotheses with 
each specific model Ai, while B represents observed data. 
P(Ai\B) means the probability of acquiring model Ai with 
given data-set B, which is usually called posterior probabil¬ 
ity; while P(B\Ai), the likelihood function concerns about 
\ 2 analysis 


P(B\A i ) = N-ex.p{~ x2{B 2 lAi) }, 


( 2 ) 


represents the possibility of acquiring data-set B with given 
model Ai. The priori, P(Ai), does not affect too much about 
estimating parameters of models, thus is often given by ex¬ 
perience. 

The decision theory based on Bayesian theorem can not 
perform in full power in comparing different cosmological 
models, not only because the convincing form of priori can 
not be given precisely, but also due to the fact that the loss 
function, which is another critical part in making decision, 
is often neglected or given by experience. But without ex¬ 
plicit forms of both priori and loss function (actually we just 
neglect their effects), we can still try to compare different 
hypotheses with Bayesian factor 


P(B\Ai) 

p{b\aw 


( 3 ) 


which in practice shares the same idea with Neyman-Pearson 
lemma. 

Neyman-Pearson lemma defines that likelihood-ratio 
test rejects hypothesis Ai in favour of A 2 when 


MB) 


P(B\A U 0) 

P(B\A 2 ,6) 


( 4 ) 


where the P is the likelihood function we talked about in 
Eq. ©, 6 is a common parameter in both hypothesis, r] is a 
kind of threshold factor in discussing about significance. 

Principally, we can choose the best theory only among 
all existing ones with Bayesian factor. But the consequent 
problem is we are not able to probe tiny systematic errors 
hidden behind observational errors, since chi-square analysis 


is not highly sensitive to tiny evolutional structure in resid¬ 
uals. This would make theoretical breakthrough hard to be 
found in phenomenological researches. 

Hypothesis test that follows Ronald Fisher’s principle 
seems to be a more direct approach, although the Fisher’s 
approac h had been ac commodated in Neyman-Pearson test 
scheme f Janie sl l200df . But we would like to conduct null 
hypothesis test as a classical significance test in Fisher’s 
scheme. 

In classical significance test, we do not talk about the 
possibility that the nu ll hypothesis can be proved, even if it 
is a truth (' Jamesll2006l l. The probability that a null hypoth¬ 
esis is not true can be expressed by the significance level of 
test. The classical significance test does not have to be ac¬ 
companied by alternative hypotheses, which is the most dif¬ 
ferent part between Fisher’s approach and Neyman-Pearson 
lemma. 

Imagine function X is only related to observation, the 
value of it lies in W where only part of W can be predicted 
from a null hypothesis H n . We define the value of X pre¬ 
dicted from null hypothesis lies in w, thus the probability 
that null hypothesis H n is not true reads 

P(X eW -w\H n ) = a, (5) 


where a is the level of significance about falsification of null 
hypothesis H n . 

We can benefit from null hypothesis test as it offers a 
standard diagnostic criteria for conveniently assessing var¬ 
ious models, since every model is presumed to be rejected 
equally at first. 

Classical hypothesis test, or more specifically speaking 
in this paper, the null hypothesis test often requires precise 
value of parameters from hypothesis in order to perform 
in full power. So the problem is, the standard cosmological 
model does not predict precise value of most of the param¬ 
eters, such as dimensionless Hubble constant h and energy 
density of dust matter f l m h 2 . Considering about that, pre¬ 
vious researchers focused on null hypotheses like “The con¬ 
stant parameters are not dynamical.”, in order to use hy¬ 
pothesis test method in testing standard cosmology. Those 
null hypotheses are all logically equaling to standard cosmo¬ 
logical model, only different in their expressions of diagnos¬ 
tic functions. The diagnostic function is actually acting as 
X in Eq. ([5)>. While focusing our discussion with flat space 
and low redshift observations, the most popular diagnostic 
function reads 


H(zW-H( Zj ) 

(1 + Zi) 3 -(1 + Zj ) 3 ’ 


where H(z) represents Hubble parameter at observed red- 
shifts Zi and Zj. T his function is also nam ed as two-point di¬ 
agnostic function fehafieloo et al.l |2012| J. since it associates 
any two points in observation data-set at different redshifts. 

The probability that the standard cosmological model 
is not true reads 


P{D ± const. \ACDM) = 1, (7) 

P(D = const.\AC DM) = 0, (8) 

where D represents a di agnostic function. This is an 
i deal but not practical rule (ISahni. Shafieloo fe Starobinskvl 
l2008h . which says the standard cosmological model is fal- 
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sified if the values of diagnostic function deviate from one 
constant at any redshift. 

According to the fact that realistic observations 
are coming with observa tional errors, a modified 
rule (ISeikel fc Clarkson! 120131 s ) has been introduced which 
says the probability of falsification reads 

P(D / const.\ACDM) = (9) 

where Len(B) means the whole redshift range of observation 
data-set B, while Len{B]D ^ const.) means the redshift 
range where diagnostic function deviates from a constant. 
Since the diagnostic function are reconstructed from data 
with observational error, its value at each specific redshift 
is expressed by a random variable with upper and lower 
limits. The limits are characterized by a level of confidence, 
for example, when P{D) = 0.68, the limits are chosen as 
l(j deviation limits from the mean value. Thus the modified 
rule can be more applicable and reasonable. 


3 AUTOCORRELATION ANALYSIS 

We find out that modified rule is still vulnerable to uncer¬ 
tainties that occurred in observations; besides, the signal of 
deviation between hypothesis and observation, even if can 
be observed with above rules, can not be clearly explained 
or quantified. Imagine we have observed some level of de¬ 
viation according to rule Eq. m, we still can not conclude 
that the deviation is due to the fact that our tested theory 
has some kind of level of deviation from the truth, since the 
deviation can be an illusion caused by systematic and/or 
random uncertainties in observation and data analysis. 

There exists a more critical question for null test in 
practice: Are we expecting to find strong evidence of ruling 
out some model with null test while same level of evidence 
has not been spotted via chi-square analysis? We do not 
attempt to address this question in this article but we keep in 
mind that null hypothesis significance test may be assigned 
to a slightly different task discussed below. 

In order to improve the null hypothesis test, we intro¬ 
duce autocorrelated analysis. The basic idea of our analysis 
is simple: Deviation between a theoretical hypothesis and 
truth can be manifested by observational inference in evo¬ 
lutional behavior of a constant parameter, where observa¬ 
tional deviation against theoretical prediction acts like sys¬ 
tematic error which unbiasedly appears in every related ob¬ 
servational samples. 

For revealing that particular systematic error we define 
an autocorrelation function C(8 Z ) of diagnostic function as 

c(e z ) = {i(o z )) B , (io) 

where 8 Z = ( Zk — zi), ( )b represents average process in 
data-set B with respect to 6 Z . The function I is defined as 

I(9 Z ) = D(z k ) - D(zi), (11) 

where D{zk) represents available values of diagnostic which 
are related to observed quantity-set q at redshift Zk- The 
value of D z can be expressed as 

D z (q z ) = Dp ro j + 5 r + 5s, (12) 

where D pro j means true value of D that should be projected 


by precise observation without any error. For the observation 
suffers from systematic error and random error, their effects 
can be added to the projected value as 5 r and d s . 

In practice we assume the probability distribution of 
observed parameter q z is gaussian, for example the possi¬ 
bility of finding the ith component q z ,i in q z at redshift 0 
equals to p reads, 

P(<lz,i = P) = Po exp{———(13) 

®i,z 

where cr i,z} is a set of observational output of quantity 

qi at redshift 2 . 

Although we are not able to express the probability dis¬ 
tribution function of D z in a specific form, we can estimate 
its statistical expectation 

£[D 2 ] = Dproj +£[(ir] —|—£[(is]; (14) 

where we presume D pro j should depend on redshift when the 
null hypothesis is not true. Random error in real observation 
also depends on redshift, ie., random observational error is 
expected to grow when redshift goes larger, but we can av¬ 
erage observational results at roughly the same redshift for 
minimizing influence of random error. 

We can also express the probability density function 
g(D ) of D z as 

£[D Z ] = j Dg(D)dD = J D(f pro j + f r + f„)dD, (15) 

where f r and f s are related to z, while f pro j should be a delta 
function independent of redshift only under null hypothesis. 
Eq. (El can be written as conditional expectation 

C(9 z )=£ Y [D Zk -D zl \, (16) 

where Y means (zk — zi) = 8 Z , as the condition of averag¬ 
ing. We can regroup the terms in C(9 Z ) according to their 
dependency on 6 Z like 

C(8 Z ) = A + B{9 Z ), (17) 

which means A contains redshift independent terms. It is 
easy to calculate that the random error term reads 

J D(fr,k-fr,l)dD, (18) 

where the offset character of random error should result 

in zero value of this term since theoretically we have 
f Y D(f r> k)dD = 0. A also contains 

D P: k — D Vy i, (19) 

under null hypothesis (D Pt k represents value of D pro j of 

£{D Zk \), but it is a 9 Z dependent variable if null hypothesis is 
violated and thus acts like a (possibly secondary) systematic 
error as we mentioned. This hypothesis-induced systematic 
error is difficult to be separated from systematic uncertain¬ 
ties induced by other sources unless they have been carefully 
evaluated and corrected. 

But we can tell the difference between cosmological 
hypothesis-induced systematic uncertainty and other sys¬ 
tematic uncertainties when apply same diagnostic quantity 
to different observations, since only cosmological hypothesis- 
induced systematic error is shared by every data-set. 

The offset between random error terms requires enough 
samples under Y condition, while in practice we change that 
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critical condition into ( Zk—zi ) = 9 z ±5g which means the av¬ 
erage operations are taken in bins. Notice that for a sample- 
set with finite redshift range, the change in Sg shall also 
change 6 Z accordingly, this can be observed in Fig. [2] 

Different from previous treatments, we do not apply 
this scheme directly for detecting whether the ACDM is in¬ 
consistent with current observations. In the next section, we 
assign it with a more tangible mission: detecting secondary 
systematic error after chi-square analysis. 


4 TINY BIAS AFTER FITTING 


Here we prove the autocorrelation analysis can serve as an 
efficient diagnostic method for detecting tiny bias after fit¬ 
ting cosmological parameters with chi-square analysis. We 
take uiCDM as a general cosmological model which at low 
redshift reads, 

h(z) = /iVf2 m (l + z) 3 + (1 - n m )(l + z) 3S , (20) 

where h(z) = H(z)/( 100 km ■ s _1 MpH 1 ), and S = 1 + w. w 
represents the equation-of-state parameter of dark energy. 
The standard ACDM model can be recovered when w = 
— 1. We presume the true Universe follows wCDM model 
with parameter {ffj),, h*, 5*}. Notice that this assumption is 
a general setting for convenience which will not affect our 
proof. 

In practice we build diagnostic function which focuses 
on Hubble constant. In the simplest case where the Hubble 
parameters at various redshift can be measured, the corre¬ 
sponding diagnostic function reads 


D{z) = -51og 10 [ 


hobs ( 2 ) 


1 + z) 3 + (1 — D m ) 


( 21 ) 


which contains observed quantities along with fiducial pa¬ 
rameter f2 m . This is a little different from what we con¬ 
fronted in section [3] where diagnostic function only contains 
observed quantities. In practice it is hard to avoid introduc¬ 
ing extra fiducial parameters, especially when using more 
precise observations, ie., SN la observation. 

So generally we re-express the diagnostic function as 
D(q, 7 ), where 7 means extra parameters. In Eg. 1211 we see 
7 = Q m . The correlation spectrum can be expressed as 


C{6 Z ) = £y [5log 10 () - 51 °Sio(S?WT)]> 


hobs (^i) 


' E(zi; 7 ) ' 


( 22 ) 


where E(z; 7 ) = ^H m ( 1 + z) 3 + 1 — f2 m . For an unbiased 
data fitting with ACDM model, the true Universe h*(z) 
must be characterized by = W m ,h* = h^,S* = 0 }. 
We set 7 with the best-fit value from chi-square 

analysis, then the autocorrelation function C(9 Z ) must yield 
zero values at each 6 Z , on the condition that every source of 
bias has been clearly corrected before and during chi-square 
analysis and we had presumed a right cosmological model. 

Deviation from C{6 Z ) = 0 may be result from bias be¬ 
fore and during chi-square analysis, and may also come from 
cosmological model we assumed if it deviates from the truth. 
Random uncertainties may also affect the diagnostic result, 
but with sufficient samples in each averaged bin, we can 
eliminate that influence and the robustness of the result 
against random error can be evaluated by using different 
width of average bin. 


The essence of this analysis is finding evolutional struc¬ 
ture in residuals, with respect to best-fitted prediction of 
chi-square analysis after dominant systematic uncertainties 
being corrected. 


5 CONFRONTING OBSERVATION 

In this section, we apply the correlation analysis to type 
la supernova (SN la) and cosmic chronometer (CC) obser¬ 
vations, which are useful and carefully analysed low red¬ 
shift observation in testing standard (ACDM) cosmological 
model. 


5.1 diagnostic function for SN la 

In order to use SN la data, we start with the relation between 
(dimensionless) luminosity distance and redshift 

* W = (I + i, f EM (23) 

where E(z'), defined by dividing Hubble parameter H(z) 
with Hubble constant Ho, is the dimensionless Hubble pa¬ 
rameter. Practically, the observed information is represented 
by distance module fi which reads 

K z ) = 51og 10 (dz,//i) + 51og 10 (3 ■ 10 s ), (24) 

where h is the dimensionless Hubble constant, defined as 
h = Ho/(100km ■ s ^ 1 • Mpc -1 ). For simplicity and accuracy, 
we define no = 51og 10 (3 • 10 s ). 

In terms of dimensionless distance, we have ignored 
the radiation and curvature terms in standard cosmologi¬ 
cal model since their contributions at such low redshift are 
negligible. So we have 

E(z) = [n m (l + z) 3 + (l-D m )] 1/2 . (25) 

Through the observational perspective, distance mod¬ 
ule fi can be obtained through fit ted li g ht-curve para meters 
with SALT-II light-curve model (iMosher et al.|[2014l ) of SN 
la observation, which reads 

/iobs — mB — (Mb + AA 1b) ~b 0 W 1 — /3C, (26) 

where m represents apparent peak magnitude of luminosity 
at B-band with M 1 as its corresponding intrinsic magnitude 
of luminosity; AMb means stellar mass related correction 
which is zero when M ste ii a r < 1 O 1 O M 0 ; X\ and C are stretch 
parameter and color parameter respectively, which describe 
the properties light-curve with m together, a and /3 are their 
constant coefficients. 

Considering both theoretical and observational expres¬ 
sion of distance module, the diagnostic function is designed 
as 

D = (m B - AMb + otX\ - /3C) - 5 log 10 d L j it . (27) 

The diagnostic quantity of this function is Mb — 51og 10 h, 
where the intrinsic magnitude of supernova has also been 
assumed to be a constant. The distance term d^jit rep¬ 
resents luminosity distance described by Eq. © obtained 
with best-fitted value. 
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5.2 test with JLA compilation 

The JLA (Joint Light-curve Analysis, which is jointly 
cond ucted by SPSS and SNLS collaborations) compila¬ 
tion (IBetoule et al.l 12014) is adopted as our SN la sam¬ 
ples. The systematic uncertainties from SALT-II light-curve 
analysis have been thoroughly evaluated with calculation 
and simulation in previous researches dGuv et al.l l20ld : 
iMosher et al.ll20l4 and careful systematic un certainty anal¬ 
ysis had been adopted in original report (IBetoule et al.l 
l20l4 . The best-fit values of cosmological parameters are 
constrained after bias corrections in light-curve parameters 
included in the released data which is adopted in our anal¬ 
ysis. 

For evaluating values of diagnostic function at vari¬ 
ous redshifts, we adopt the JLA’s original report where 
a = 0.141, /3 = 3.101, A Mg = —0.07 which are best-fit 
parameter values with systematic uncertainties and bias cor¬ 
rections included in chi-square analysis. The joint analysis 
also conduct param eter constraints accor ding to joint anal¬ 
ysis of Planck2013 (IPlanck CollabJ l2013h and JLA, which 
yield slightly higher matter density = 0.305±0.010 than 
from JLA alone which gives ftm = 0.295 ±0.034 while other 
parameters suffers smaller differences. Avoiding from bring¬ 
ing possibly extra unknown tiny uncertainty from combining 
two independent data-sets (IPlanck Collab.ll20l4 . we adopt 
best-fitted ft m = 0.295 according to JLA sample only. 

We also generated a simple set of mock observational 
data which also contains 740 samples for comparing their re¬ 
sults. T he mock data-se t is produced as procedure described 
bellow (lKarpenkall2015l l : 

1. The redshift is drawn independently from Zi ~ 
[7(0,1.3), where U(a,b) denotes a uniform distribution in 
the range [a, 6]. 

2. The predicted distance module at redshift Zi 
fi m = 0.3, h = 0.7) is calculated using Eq. (l24l) . 

3. The hidden variables Mi (intrinsic magnitude), Xi : i 
(stretch parameter) and Ci (color parameter) are drawn 
from the respective distributions Mi ~ A/”)—19.03,0.02), 
X 1:i ~ [/(—2.862, 2.337) and Ci ~ CT(—0.250, 0.260), where 
A/"(/r,(j 2 ) denotes a normal (Gaussian) distribution with 
mean fj, and variance a 2 . 

4. The value of rriB,i is calculated using the Phillips 
relation rriB,i = n(Zi, 0.3, 0.7) + Mi — aXi y , + /3C;. 

5. The simulated observational data are drawn inde¬ 
pendently from the distributions Zi ~ Af(zi,a 2 ), rriB,i ~ 

A/’(ms li ,(rj li ,), Xi,i ~ J\f(X 1:i ,cTx,i) and Ci ~ J\f(Ci,crc,i), 

where crx,i, trc.i} are drawn randomly from uniform 

distributions a m ,i ~ 17(0.09,0.175), ax,i ~ 17(0.018,1.641) 
and ac,i ~ 17(0.012,0.107). All upper and lower limits in 
uniform distributions mentioned in each step are obtained 
from real JLA data-set. 

We do not re-constrain the fiducial cosmology which has 
{fi m = 0.3, ft = 0.7, a = 0.12,/3 = 3.2} according to mock 
data, but reproduce the diagnostic function C(9 Z ) with fidu¬ 
cial parameter-set (fl m , a, /3} since we do not doubt whether 
chi-square fitting scheme in real SN la analysis may intro¬ 
duce systematic bias. 

The simulation process adopted here is far from real¬ 
istic, but it is sufficient for comparing results from correla¬ 
tion analysis with simulated and real observed data-set. The 
point is that we are trying to estimate the influence from 


random error and finite sample number in blurring signals 
in our analysis. If the result from real data lies within the 
region of simulated result, then we conclude there exists no 
noticeable hidden systematic uncertainties. Thus our focus 
here is about evaluating blurring range (as shown by black 
points with error bars in Fig. [TJ from random error rather 
than conducting extremely realistic simulations of observa¬ 
tion. 

Notice that in step 5 we concern analyzing uncertainties 
in light-curve parameters, which may lead to un-expected 
systematic-like uncertainties in final result since observed 
sample number is finite. In order to include various possi¬ 
bilities, we generate a general mock data-set (displayed in 
Fig-0 in which mean value of light-curve parameters are set 
by true values, and extend the error to the maximum 2 <j level 
as (Jm,i = 0.35, ac,i = 0.214 and ax,i = 3.282. Systematic- 
like fluctuations in each correlation spectrum from a single 
mock data-set can be well included by 2 a evaluation uncer¬ 
tainties of this general data-set as shown in Fig. [T| 

The means and standard deviations of values of C(9 Z ) 
is estimated by the following process: First, for each SN la 
sample at redshift, ie., Zk, we can estimate the distribution of 
value of diagnostic function and characterize it by its mean 
and standard deviation. Then for each pair of SN la samples, 
distribution of value of Eq. m can be estimated. We also 
characterize each I with its mean and standard deviation. 
In order to realize average condition Y as we previously 
mentioned, mean value and standard deviation of C in each 
9 Z -bin are estimated through unconstrained averaging with 
standard weighted least-squares method, which reads 

C ± SC = ± (S(28) 

where the weight Wi is 


C and SC stand for mean value and standard deviation of 
value of C{9 Z ) in each bin, while U represents each mean 
value in the same bin with its wight calculated from stan¬ 
dard deviation. Notice that we estimate D(z) in bins directly 
before calculating C(9 Z ) through the same average method, 
which is displayed as bottom panel in Fig. [4] 

The autocorrelation spectrums from JLA and mock 
data-sets are displayed in Fig. |T| where we conduct expec¬ 
tation operation Ey[ ] in bins which means Y represents 
|Zk — zi | = 9 Z ± 0.025. The robustness of taking different 
binning widths is shown in Fig. [2] we also tried randomly 
dropping one third number of samples in the full data-set 
but the result is negligibly affected. 

Since the mock data-set is free from systematic uncer¬ 
tainties, its spectrum remains relatively horizontal as we ex¬ 
pected. We also checked the final error in reconstructed value 
of D, the mock data can provide average final standard de¬ 
viation 0.178 which is exactly the same as that from real 
data. 

Real observational result shows an noticeable deviation 
from horizontal line, we think that pattern results from ei¬ 
ther un-concerned tiny systematic uncertainties in data or 
cosmological hypothesis. 

We also find that replacing standard cosmology by 
uiCDM model with EoS parameter of dark energy lower 
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Figure 1. Autocorrelation function constructed according to JLA 
compilation (with best-fit parameter setting) and the general 
mock data-set separately. The evaluation errors are at lcr level, 
we can observe the results from real observation deviate at more 
than 2 cr level from those of general data-set at redshift higher 
than about 0.3 and lower than about 0.8. 



Figure 3. Number of sapmles included in each bin (when calcu¬ 
lated in 26 bins), where one sample indicates a pair of two obser¬ 
vational points at different redshift. For JLA compilation which 
contains 740 observed points, the total amount of “sample” is 
about 270 thousand. 






Figure 2. The same function according to real data in Fig. |T| 
but calculated with different widths of bins, showing the binned 
estimation of C(6 Z ) is robust. 


than —1 may ease the decreasing pattern in C{6 Z ), as shown 
Fig. H] which indicates the C(9 Z ) of real SN la observation 
is sensitive to cosmological model parameters. But we are 
not suggesting that uiCDM with phantom-field can fit bet¬ 
ter with current covariance matrix provided. As a matter of 
fact, w = — 1.1 only meets the edge of la confidence rang e 
in the likelihood of given fitting result dBetoule et al.ll20l4l . 
Fixing that deviation requires more exquisite analyzing pro¬ 
cesses and precise bias corrections in the future. 


5.3 diagnostic function for cosmic chronometers 


Cosmic chronometers (CC) are relatively more direct probes 
for cosmic expansion rate H(z), which relates to age differ¬ 
ence of early type galaxies (ETGs) as 


H(z) 


1 dz 
1 + z dt ’ 


(30) 


where dt represents age difference between galaxies with red¬ 
shift difference dz. The age differences were historically mea¬ 
sured in two methods due to the fast development in astro- 


I l JLA 25bins 
$ jfc JLA 5bins 

T 




0.0 0.2 0.4 0.6 0.8 1.0 1.2 


Figure 4. Top: Autocorrelation function constructed according 
to JLA compilation with ACDM which has best-fit parameter set¬ 
ting (white), in contrast with spectrum (red) with kiCDM which 
changes w = —1.1 and = 0.3156. Bottom: Estimating D(z) in 
redshift bins, from which we can observe deviation clearly. This 
figure verifies the result of C(0 Z ) in Fig. [2] 
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physical observations and analyses. With relative age based 
method, the age of ETGs are measured by stellar popula¬ 
tion synthesis models, while the D4000n m ethod concerns 
the spectral 4000 A break feature in ETGs dMoresc 3 EH) 
which is approximated to be linearly related to galaxy age 
as 


D4000(Z) = A(SFH, Z/Z 0 ) ■ age + B{Z), (31) 


where Z represents metallicity, B and A are constant pa¬ 
rameters, SFH means the parameter A also depends on star 
formation history. Cosmic expansion rate at redshift 2 is 
defined as 


H(z) 


1 dz 

1 + 2 d£>4000’ 


(32) 


where dD4000 means the average difference in 4000 A break 
corresponding to redshift difference dz. 

In order to make our analysis directly comparable with 
that to SN la, we point out a simple diagnostic function 
which shares similar diagnostic quantity h as 


D = —51og 10 { 


K*) 

\/~ 1 rn (1 T 2 ) ^ + ( 1 



(33) 


where h(z ) = H(z). We adopt the simplest model for low 
redshift expansion prediction as we did for SN la analysis 
under ACDM hypothesis. 


Table 1. CC-M15 compilation of H(z) measurements, we had 
dropped 2 samples at redshift 0.48 and 0.88 due to their large 
measurement errors. 


z 

H(z) ( km/s/Mpc ) 

era 

0.09 

69 

12 

0.17 

83 

8 

0.179 

75 

4 

0.199 

75 

5 

0.27 

77 

14 

0.352 

83 

14 

0.4 

95 

17 

0.593 

104 

13 

0.68 

92 

8 

0.781 

105 

12 

0.875 

125 

17 

0.9 

117 

23 

1.037 

154 

20 

1.3 

168 

17 

1.363 

160 

33.6 

1.43 

177 

18 

1.53 

140 

14 

1.75 

202 

40 

1.965 

186.5 

50,4 


Table 2. Best fit values of ujCDM and to z CDM model with CC- 
M15. 


5.4 test with CC-M15 

The latest update (M15) of CC data-set was reported by 
M. Moresco IIMoresc 3120151) where two new measurements of 
Hubble paramet er with D 4000 method were added to the old 
CC c ompilation (ISimon, Verde fe Jimene3l2005l : lstern et ahl 
l20ld h Two observed points at redshift 0.48 and 0.88 are re¬ 
moved, since the relative estimation errors in those H(z) are 
too large to protect their sampling from touching negative 
value. We name the new compilation as CC-M15 (as shown 
in Tab.[T|, the systematic errors and consisten ce between dif¬ 
ferent measurements were carefully analysed dMoresco et al.l 
l2012al lblh Since the quality of this measurement is still low 
in comparison with SN la, its capacity in distinguishing cos¬ 
mological parameters is thus not very powerful. But M15 
update greatly increased its redshift depth to about 2.0, 
which makes CC the most deep cosmological data-set in¬ 
dependent from CMB at present. We fit ACDM model with 
the data-set and get best-fit results: = 0.318, h = 0.689 

with xhin/dof = 0.719. 

The autocorrelation functions with various number of 
average bins are displayed in Fig. [5] there is no noticeable 
leftover systematic errors. Uncertainties in evaluating cor¬ 
relation spectrum binned values are large enough to cover 
the zero line. We try to fit CC d a ta with w CDM and 
U) Z CDM dChevallier fc PolarskilEoOll ; iLinded [20031 1 models 
and get Tab. [5] Replacing ACDM by those two model with 
fitted values has negligible effect on the spectrum. This is 
mainly due to the shortcoming in sample number and large 
observational errors. 

According to the analysis with CC data-set, we can not 
capture similar information as which from JLA data-set. No 
tiny systematic uncertainty can be measured. This means 
with present accuracy of CC data, constraining standard 
cosmological model and even non-standard models is not 


model 

^771 

h 

WO W a 

Xhin/ d °f 

uiCDM 

0.311 

0.681 

-0.913 

0.763 

uJzCDM 

0.226 

0.693 

-0.966 0.900 

0.809 


significantly affected by hidden systematic errors, although 
the results from data fitting also suffers from relatively low 
precision. But the physics behind CC observation is much 
more simpler and the data extracting process is affected by 
less systematic uncertainties, we consider that as the advan¬ 
tage of cosmic chronometers against SN la. More observa¬ 
tional samples of cosmic chronometers are highly expected 
in order to conduct cross check with SN la data and realise 
the final goal of our test. 


6 DISCUSSION 

In this paper we introduced a correlation scheme for detect¬ 
ing hidden systematic uncertainty after chi-square analysis. 
The goal of our work is about providing efficient and sensi¬ 
tive methodology for estimating possibly tiny unconcerned 
or cosmological hypothesis-induced uncertainties. With im¬ 
provement in quality and quantity of observed samples in 
the future, this method can also serve as an useful tool for 
seeking indication of imperfectness in standard cosmological 
model. 

With currently observed SN la data, we find existence 
of tiny systematic errors after previous analysing which 
suggests there may be unconcerned subdominant but still 
detectable systematic uncertainties or indication to non¬ 
standard cosmological model. Although such systematic de¬ 
viation can be catched by our analysis, it has slight influ¬ 
ence in likelihoods of estimated parameters. We suggests 
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J l CC-M15 lObins 
J l CC-M15 7bins 
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^ 0.0 
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observations, the analyzing scheme can be applied to other 
measurements of theoretical parameters as well. 
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Figure 5. Top: Autocorrelation functions calculated according 
to CC-M15 H(z) data-set with different number of bins, showing 
result is also robust. Bottom: Number of samples contained in five 
bins, the definition of “sample” is the same as that in Fig. [3] 


that addressing that issue can help in providing better con¬ 
straints o n cosmological pred ictions. According to the latest 
research (IRigault et al]l2015T l , the intrinsic luminosity of SN 
la is affected by star formation status of its host galaxy, 
thus we can not exclude such possible selection bias in ob¬ 
servation at present. We hope to overcome those difficulties 
in future research when better observational correction in 
large sample of SN la observations is available. 

In terms of CC data, we find the correlation analysis 
is affected by the lack of sample number and quality. But 
current data seems fine with no noticeable leftover system¬ 
atic uncertainties. We are looking forward to see more CC 
samples coming in the future, then comparing the correla¬ 
tion spectra from SN la and CC can tell whether there exists 
common feature, which is very likely induced by uncertainty 
from cosmological model. 

Our result seems to be unexpected, since intuitively we 
don’t think there still exist detectable system atic uncertain¬ 
ties af ter impressive bias control adopted bv lBetoule et all 
(I20l4l . The truth is that systematic deviation in Fig. |T] is 
not detectable at all in Hubble diagram, but only noticeable 
through autocorrelated analysis. Thus there is no contradic¬ 
tion between our result and that from JLA original analysis, 
the point is that we are looking into the evolutional struc¬ 
ture of residuals in Hubble diagram. Similar to our method, 
fitting parameters in redshift bins may also address such 
issue, but the signal may also be blurred by observational 
uncertainties. 

Although we only focus on low redshift astrophysical 
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